Real-Time Hand Tracking and Gesture Recognition System
نویسندگان
چکیده
In this paper, we introduce a hand gesture recognition system to recognize real time gesture in unconstrained environments. The system consists of three modules: real time hand tracking, training gesture and gesture recognition using pseudo two dimension hidden Markov models (P2-DHMMs). We have used a Kalman filter and hand blobs analysis for hand tracking to obtain motion descriptors and hand region. It is fairy robust to background cluster and uses skin color for hand gesture tracking and recognition. Furthermore, there have been proposed to improve the overall performance of the approach: (1) Intelligent selection of training images and (2) Adaptive threshold gesture to remove non-gesture pattern that helps to qualify an input pattern as a gesture. A gesture recognition system which can reliably recognize single-hand gestures in real time on standard hardware is developed. In the experiments, we have tested our system to vocabulary of 36 gestures including the America sign language (ASL) letter spelling alphabet and digits, and results effectiveness of the approach.
منابع مشابه
Neural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملApplying mean shift and motion detection approaches to hand tracking in sign language
Hand gesture recognition is very important to communicate in sign language. In this paper, an effective object tracking and hand gesture recognition method is proposed. This method is combination of two well-known approaches, the mean shift and the motion detection algorithm. The mean shift algorithm can track objects based on the color, then when hand passes the face occlusion happens. Several...
متن کاملHuman-computer Interaction Using Real Time 3d Hand Tracking
This paper describes a real time system for human computer interaction through gesture recognition and three-dimensional hand tracking. We use one camera that is focused at the user's hand, with an attached small rigid dark square. The system can recognize in real time the gesture and track the hand in three dimensions. The system uses a SIMD real time image processing board for low and interme...
متن کاملHand Sign Recognition through Palm Gesture and Movement
We propose and implement a new method of detecting hand signs by combining skin color detection in transformed 2D normalized RGB or YCbCr color space, PCAbased detection of hand gestures and movement tracking of hand centroids. Hand gesture recognition is a field of research with growing applications, and the implemented system uses movement-tracking pairing for more granular recognition and co...
متن کاملHand gesture recognition using a real-time tracking method and hidden Markov models
In this paper, we introduce a hand gesture recognition system to recognize continuous gesture before stationary background. The system consists of four modules: a real time hand tracking and extraction, feature extraction, hidden Markov model (HMM) training, and gesture recognition. First, we apply a real-time hand tracking and extraction algorithm to trace the moving hand and extract the hand ...
متن کامل